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Introduction 


Prediction  ot  future  flying  program  activity  are  critical  elements  in  the  requirement 
computations  for  both  reparable  and  consumable  items.  In  both  of  these  requirements 
computations,  it  is  assumed  that: 


Demand  is  proportional  to  flying  program  activity,  and 


2.  It  is  possible  to  accurately  forecast  the  flying  activity  to  be  performed  in 
future  periods. 


In  this  paper,  we  use  historical  data  for  calendar  years  1973  through  1979  to  test  the 
second  assumption.  That  is,  we  compare  forecasts  of  flying  program  activity  made  during 
these  years  to  the  actual  flying  activity  which  was  eventually  performed.  In  the  next 
section,  we  discuss  the  sources  of  data  used  in  our  computations  more  fully,  and  describe 
the  calculations  used  in  comparing  predicted  and  actual  flying  programs.  In  the  appendix, 
we  present  plots  for  26  USAF  aircraft  describing  both  program  activity  and  forecasting 
accuracy  observed  during  this  time  interval. 


Data  Sources 


We  obtained  the  data  documented  in  this  report  from  two  major  sources.  Observed 
aircraft  flying  program  data  was  obtained  from  the  G033J  system  from  output  product 
A-G033J-PAR-M  1-MMO.  This  information  was  collected  for  the  interval  July  1970 
through  June  1979.  Predictions  of  flying  program  activity  which  were  made  each  quarter 
throughout  the  1970s  were  obtained  from  the  K004  data  system,  using  report  K004.D81Af 


2 


RCS:  NR-LOG-LR(AR)720S.  Appendix  A  ot  reference  1  presents  the  actual  program 
activity  data  ojyfamed  in  this  process,  while  Appendix  B  of  reference  1  presents  the 
forecasts  o?\2  months  flying  anivitv  obtained  from  the  K0Q4  system.  Table  I  illustrates 
the  data  pre^sqted  in  Reference  1.  The  top  of  Table  I  presents  the  actual  flying  program 
activity  for  B- 52  weapon  systems  by  quarter  for  CY1971  through  1979.  Similarly,  the 
bottom  portion  of  Tabl^^^presents  tljie  predicted  one  year  B- 52  flying  programs  in 


hundreds  of  hours.  These  predicted  hours  are  the  total  flying  hours  predicted  to  be  flown 
during  the  succeeding  12  month  period.  For  example,  at  the  beginning  of  the  first  quarter 
of  CY  197  3,  Air  Force  planning  documents  were  predicting  a  total  of  230,800  hours  of 
B- 52  flying  activity  for  the  next  12  months,  i.e.,  for  quarters  one  through  four  of  CY 
197  3.  Each  quarter  the  flying  program  forecasts  are  updated.  At  the  beginning  of  quarter 
two  of  CY  197  3,  the  revised  12  month  forecast  of  B-52  flying  activity  (for  quarters  2,  3, 
and  4  of  CY  1973  and  quarter  1  of  CY  1974)  was  211,900  hours.  Other  revised  forecasts 
are  presented  in  the  table,  with  each  forecast  representing  a  prediction  for  the  future 
12-month  interval. 


We  next  computed  the  ratio  of  predicted  to  actual  flying  programs  for  the  B-52  and  a 
number  of  other  USAF  weapons.  We  refer  to  this  number  as  the  "forecast  accuracy 
ratio."  Table  11  illustrates  this  computation.  For  example,  at  the  start  of  the  first 
quarter  of  CY  1973  (Quarter  No.  9),  a  total  of  230,800  hours  were  forecast  as  the  B-52 
flying  program  for  the  next  12  month  period.  As  it  turned  out,  a  total  of  203,703  hours 
were  actually  flown  by  B-52  aircraft  during  this  interval.  The  ratio  of  the  predicted  to 
actual  hours  is  1.133,  the  number  shown  in  the  right  hand  column  of  Table  II.  That  is,  the 
predicted  program  was  13.3%  more  than  the  hours  that  were  actually  flown.  Similarly, 
when  the  12-month  forecast  for  the  second  quarter  of  CY  1973  was  divided  by  the 
corresponding  actual  hours,  a  program  ratio  of  1.220  was  obtained.  The  right  hand  column 
in  Table  II  presents  similar  ratios  associated  with  other  forecasts  of  B-52  flying  programs 
made  throughout  the  1970s. 
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Table  I 


B 52  Actual  Flying  Program,  CY1971-79 
(Hours) 
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Figure  l  plots  of  the  actual  and  predicted  flying  programs  for  the  B-  52  for  CY71-79, 
as  well  as  t he  forecast  accuracy  ratios  presented  in  Table  11.  The  solid  line  in  Figure  1A 
represents  actual  quarterly  B  “>2  flying  activity,  while  the  dashed  line  in  this  figure 
represents  the  corresponding  predicted  program  normalized  to  a  quarterly  value.  On  the 
other  hand.  Figure  IB  plots  the  forecast  accuracy  ratio  associated  with  these  observa¬ 
tions.  As  seen  in  these  figures,  the  predicted  flying  program  was  generally  above  the 
observed  program,  although  the  forecast  error  became  much  smaller  during  the  latter 
years  of  the  197  3-1979  interval. 

We  developed  similar  curves  for  the  26  USAF  aircraft  associated  with  the  INSSIM 
D062  Oata  Bank.  These  curves  are  presented  in  Appendix  A.  As  observed  in  Reference  1, 
almost  all  of  these  weapons  show  significantly  declining  programs  throughout  the  1970s. 
Some  of  the  weapons  completely  phased  out  of  the  USAF  inventory.  In  this  case,  the  very 
small  number  of  actual  flying  hours  resulted  in  forecast  accuracy  ratios  which  were  quite 
erratic. 


Analysis  of  Variance 


We  were  interested  in  testing  the  hypothesis  that  forecasting  accuracy  differed 
among  weapon  systems,  and  that  forecasting  performance  changed  as  a  function  of  time. 
To  do  this,  we  utilized  the  data  presented  in  Appendix  A  to  develop  Table  111.  In  this 
table,  we  have  recorded  the  forecast  accuru'-v  ratio  associated  with  the  specific  flying 
program  forecast  made  at  the  beginning  o?  each  calendar  year  from  1973  through  1979  for 
each  of  the  aircraft  in  our  data  file.  We  then  used  this  data  to  compute  the  average 
forecast  accuracy  ratio  and  the  coefficient  of  variation  of  these  ratios  for  each  weapon 
and  for  each  calendar  year.  As  shown  in  the  figure,  the  grand  average  of  all  these 
forecast  values  was  1.12,  i.e.,  for  all  of  the  forecasts  made,  the  predicted  program 
averaged  12%  higher  then  the  number  of  flying  hours  which  were  eventually  flown. 


Comparisons  of  Predicted  and  Actual  B-52  Flying  Programs 


Note 1  Quarter 


♦During  these  periods,  actual  flying  hours  were  so  low  that 

tre  accuracy  ratios  are  not  meaningful.  To  prevent  these 
points  from  biasing  our  results  upward,  the  true  values 
were  replaced  by  1.000. 


Table  IV  presents  an  Analysis  of  Variance  (ANOVA)  Table  lor  testing  lor  sigmlicant 
differences  m  predicting  accuracy  among  weapons  and  among  the  dillerent  calendar 


v ears.  This  intormation  indicate  that  there  is  no  statistical  basis  for  concluding  that 
there  is  any  sigmlicant  diilerences  in  foret  asting  accuracy  among  weapons  or  among  time 
periods.  That  is,  it  appears  reasonable  to  assume  that  each  forecast  accuracy  ratio  may 
be  considered  as  a  random  observation  from  the  same  probability  distribution.  Con¬ 
sequently,  we  developed  a  frequency  distribution  using  all  of  the  forecast  accuracy  ratios 
presented  in  I'ablelV.Our  results  are  presented  in  Figure  2.  As  shown  in  the  figure,  the 
combination  ot  all  the  forecast  accuracy  ratios  have  a  mean  of  1.123,  and  a  standard 
deviation  ol  .175.  The  minimum  forecast  accuracy  ratio  was  .763,  while  the  maximum 
observed  value  (after  correcting  for  the  outhers  as  described  in  the  notes  to  Table  III)  was 
1.812.  As  shown  in  the  figure,  most  of  the  accuracy  ratios  are  greater  than  one, 
indicating  that  the  majority  of  forecasts  exceed  the  corresponding  actual  flying  programs. 

Smiiin  ary 

This  paper  presents  statistical  data  comparing  predicted  12  month  flying  hour 
programs  with  the  corresponding  program  hours  that  were  eventually  flown.  The  data 
covered  the  interval  CY73-CY79  for  26  different  USAF  aircraft.  Most  of  these  aircraft 
experienced  significant  program  reductions  during  the  CY73-CY79  interval.  In  general, 
predictions  of  flying  activity  exceeded  the  number  of  hours  eventually  flown.  These 
forecasts  averaged  12%  above  the  eventually  observed  program,  though  individual 
forecasts  ranged  from  76%  to  181%  of  the  eventually  observed  values.  Further,  a  rather 
crude  Analysis  of  Variance  indicates  there  is  no  significant  difference  in  forecasts 
accuracy  among  weapon  systems  or  among  the  different  fiscal  years. 
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Figure  k. 

Frequency  Distribution  of 
Forecast  Ratios,  CY  V>79. 
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